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Abstract 

^ I In principle, all the natural systems such as biological, ecological and economical 

■ systems are structure- variable systems (in which some environment parameters are not 
. fixed). In this Letter we show that data sequences from many structure- variable sys- 

if^ I tems are short-term predictable. We also argue how to characterize the data sequences 

' from structure-variable systems. 
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In the last two decades, there has been rapid progress in understanding deterministic 
chaos, not only in theoretical modelling [1], but also in experimental testing [2]. Since the 
the pioneering paper in [3] and an embedding theorem due to Takens [4], it becomes widely 
O ■ known that the current state of the finite-dimensional dynamical systems can be identified 
using a vector of time series measurements. In the proxy state space consisting of the delay- 
^ ! coordinate vector, analysis of the topological properties of the chaotic attractor underlying 
^ I the time series is performed. The application of this idea includes noise filtering [5], control 
of unstable periodic orbits solely from a time series record [6], and prediction of the chaotic 
time series [7-8]. 

Up to now, all the studies and the applications are restricted to the chaotic dynamics 
of structure-invariable systems (SIS) (in which all the parameters are fixed) or assumed 
structure-invariable systems [9-11]. However, many natural systems such as biological, eco- 
logical and economical systems belong to structure-variable systems (SVS (in which some 
parameters are not fixed), they have developed into other ones before they reach equilibrium 
states. The stock system, the financial expenditure system for one country, the seismic sys- 
tem and the climatic system are examples since the environments of these systems changes 
rather rapidly before they settle down at some asymptotic states. Remarkably, it was found 
recently [12] that the Chinese national financial expenditure from 1973 to 1992 can be well 
predicted based on the records in 1953-1972 by a nonlinear prediction algorithm [8]. It is 
well known that the Chinese economical environment had been changed greatly from 1953 
to 1992. One may ask a question. Why does a SIS prediction algorithm work so well? The 
first motivation of this Letter is to present an approach to answer this question and then the 
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numerical results in [12] can be understood. We will use the concept of developing diagram 
[13] to illustrate our idea. It is found that every SVS can be transferred into a corresponding 
higher-dimensional SIS by adding some new variables so that the nonlinear SIS prediction 
algorithms can work well for SVSs. Moreover, in the last decade, there has been a lot of work 
trying to apply the chaotic dynamics to many natural systems [e.g. ,9-11]. The correlation 
dimensions {D2) and the largest Lyapunov exponents (A) are calculated with the familiar 
algorithms for chaotic attractors in SISs, and the existence of those quantities has been con- 
sidered as evidence of chaotic dynamics in those natural systems. In principle, many of these 
natural systems are SVSs. Only when the environment parameters change sufficiently slowly, 
a theory of SISs can be a well approximate tool to analyze the data sequences from them. 
However, there are no asymptotic limit sets in the SVSs. Consequently, it is inconvenient to 
take the dynamics of the SVSs as chaotic dynamics although the real dynamics still reveals 
sensitivity to initial conditions. Even in these SIS, transferred from SVSs, there are still no 
chaotic attractors at all (will be discussed later). An argument about the physical meaning 
for these calculated D2 and A is the second motivation of this Letter. 

Let us begin with a typical developing digram [13] shown in Fig. 1 for the logistic map 

Xn+l = f{^^, Xn) = 1- l^xl, (1) 

in the parameter interval /i G [1.6,1.8]. In the figure, we cover the parameter range ^ G 
[1.6, 1.8] by small steps 6fi = 10^^ (as that usually used in bifurcation diagrams). At fi = 1.6, 
an initial value of xo is chosen which may be a point on the attractor. We iterate the Eq. 1 
only once with fj, — 1.6 and obtain a point xi. In the successive parameter /j, — 1.6 + 5fj,, an 
iterate X2 of Eq. 1 is obtained starting from xi by considering the continuously evolutionary 
process of natural systems. We repeat it until we reach fi = 1.8 and draw all the pairs (1.6, 
Xo), (1.6 + 6fi, Xi), (1.6 + 26fi, X2), • ■ • in a figure. In this way we get the developing diagram 
in x — n coordinates as shown in Fig. 1. In the process, no point is thrown away as transient. 
This developing diagram reflects the evolutionary process of a SVS modelled by the logistic 
map with a definite rapidity (the parameter step S/i reflects the rapidity of evolutionary 
process of the dynamical system). It can be taken as the simplest example of SVSs. In [13], 
the basic properties of this developing diagram such as the discontinuity of period-doubling 
bifurcations, the time arrow [14] and a brief comparison with those of the bifurcation diagram 
had been discussed. 

Now we test the short term predictability for the above developing diagram. Considering 
that there is a data sequence Xi, X2, • ■ ■ from a SIS, according to Takens' theorem [4], there 
exists a function F such that 

•^n P'iS^n—mTi -^n— (m— 1)t) ' ' ' i -^n— t); 

where m is the embedding dimension, and r is the time-delay. The problem of predictability 
is how to find a good estimate of F based on the past history of a;„, on which various 
techniques of nonlinear deterministic prediction have been developed. In this Letter, we 
will use the prediction algorithm [8] which is based on the wavelet analysis and the neural 
networks [15]. This prediction algorithm has succeeded in testing the time series from many 
dynamical models such as the Ikeda map, the Lorenz equations, the Ushiki map, the Mackey- 
Glass differential-delay equations, etc for fixed parameters [8] . 
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Suppose 'i(^{x) {x e R") is a wavelet function, which can be thought of as a band-pass 
function. Define 

N 

9{x) = Wi^DzRiix - bi)) +g, xe i?", 

i=l 

where the 6j's are arbitrary translation vectors; the Dj's are diagonal matrices built from 
arbitrary dilation vectors (i.e., Di =diag((ij), di = {du,d2i, ■ ■ ■ ,dni) is the dilation vector); 
the RiS are rotation matrices, which are used to compensate for the orientation selective 
nature of the dilations; the parameter g is introduced to help dealing with nonzero mean 
functions on finite domains (since the wavelet if){x) is zero mean); and the Wi are weight 
coefficients. It had been proved [15] that for any function in L^(i?"), there exist some g(x) 
with proper parameters such that the function can be approximated by g{x). Our prediction 
algorithm [8] was proposed by determining the free parameters of g{x) such that g{x) can 
be a good approximation to the function F in Eq. 2. And the wavelet function il^{y) was 
chosen explicitly as 

V'(y) ^ ^{yi)i^{y2) ■ ■ ■ uj{ym) 

with [15] 

uivi) ^ {1 - y^)e-^ , 

where yi,i — 1,2, - ■ ■ ,m are m components of the reconstructed vectors. 

For the data sequences xo,xi, - ■ ■ from the developing diagram in Fig. 1, we fix the em- 
bedding dimension m = 2 (will be discussed later), and predict one step ahead. We take 
arbitrary 2000 data points in succession from the developing diagram in Fig. 1. The first 
500 points are taken as input to determine the parameters in the prediction algorithm then 
we use thenext 1500 points as the test points of prediction. All of our numerical results are 
very satisfactory. In Figs. 2-3 we show typical prediction results and the absolute predic- 
tion errors for the parameter range [1.74,1.76]. It is remarkable to find that the algorithm 
works so well that it can even predict the period 3 motion. Similar observations have been 
obtained for different selected S/i as well as in other range of parameters. We emphasize 
that the developing structure with variable parameters of the logistic map (which is a SVS) 
including its periodic motion and its period-doubling counterparts can be well predicted with 
a sophisticated prediction algorithm for SISs. 

In fact, the developing diagram shown in Fig. 1 is a trajectory in the phase portrait of 
the following two-dimensional (2D) map 

from a 2D initial point (x,^) = (xq, 1.6). The only parameter in this 2D map is Sfj,. Once 
the parameter 5fi is fixed, the developing structure of the logistic map shown in Fig. 1 can 
be described by a 2D SIS (2). As that has been shown above, we do have succeeded in 
predicting the developing structure of the logistic map shown in Fig. 1 with a 2D prediction 
algorithm (m=2) for SISs. 

Now we get the first conclusion for this Letter. A SVS can be discussed in its variable- 
parameter space in which the SVS is transferred into a higher-dimensional SIS so that the 
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data sequence is short-term predictable. We have checked this idea for many other dynamical 
systems. In Fig. 4 we show our prediction results for the developing structure of the Henon 
map 



where ao =1.52, 6o=0.1, 5a — 2*10~^ and Sb — 3*10~^. Our prediction algorithm still works 
very well. 

From the above discussion we can understand the numerical result in [12] for the Chinese 
national financial expenditure from 1953 to 1992 and other economic data series. Since the 
natural environment and the political structure had not changed much from 1953 to 1992, 
the evolutionary process of the economical environment in this period might be governed by 
some equations similar to the Eq. 5 (though we might not know exactly what they are). 
In this variable-parameter space the system is a SIS so that the data sequence might be 
well predicted. With this idea, we have successfully tested some seismological data in China 
recently [16]. Now we come to the second point in this Letter. How could a data sequence 
from a SVS be characterized? So far, there are many sophisticated ways of characterizing 
chaotic attractors, among which the Lyapunov exponents and the correlation dimensions are 
widely used. In the last decade, these techniques had been applied to the data sequences 
from many natural systems. D2 and A are calculated and their existence has been considered 
as evidence of chaotic dynamics in those natural systems [e.g. ,9-11]. In fact, many of these 
natural systems are SVSs. Only when the environment parameters change sufficiently slowly, 
these technique can be approximately used to analyze the data sequences from these natural 
systems. A SVS does not exhibit chaotic attractor since there is no asymptotic state. For 
these SISs from SVS in the variable-parameter space as Eq. 3, there is no unstable periodic 
orbit in their asymptotic state since the parameter /i always increases. As a result, it seems 
inconvenient to apply the ways of characterizing chaotic attractors to analyze the data se- 
quences from SVSs although these data sequences might be predictable. However, A and 
D2 did have been calculated for the data sequences for some natural systems [e.g., 9-11] by 
using the usual algorithms for chaotic attractors. What do these calculated A and D2 mean? 
Are they the evidence that the environment parameters for these natural systems change so 
slowly that they can be approximately taken as SISs? Could the existence of those quantities 
be taken as evidence of chaotic dynamics in those natural systems? In order to answer these 
questions we have calculated the values of A and D2 for 10,000 data sequences for the devel- 
oping structure of the Henon map in Eqs. 4 and 5 with the algorithms by [17,18]. They exist 
and D2=1.25±0.1 and A=0.294±0.002. We also have computed these quantities for other 
developing parameter ranges of the Henon map and the logistic map. From these results, 
it is clear that the existence of the calculated A and D2 does not represent that the system 
evolves so slowly that it can be approximated by a SIS. However, the positive value of A are 
consistent with the sensitivity to initial conditions of these nonlinear dynamical systems in 
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with parameters (a, b) change simultaneously as following 



K+l + dnSb, 



(5) 
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our calculations and a little smaller than the largest Lyapunov exponents for the dynamical 
systems with fixed parameters in the developing parameter range except for periodic orbits, 
and the correlation dimensions are greater than those for the fixed parameters of which the 
above developing diagram sweeps out (For the Henon map. 1)2=1 -03^10.02. A=0.353±0.003 
for (a, 6) = (1. 52,0.1) and D2=1.07±0.01, A=0.321±0.001 for (a, 6) = (1. 5955,0. 14671), corre- 
sponding to the first and the last datum, respectively). The physical meaning for these 
calculated quantities and how to characterize the data sequences from SVS still need to be 
investigated, which will be presented in an extended paper. 

It should be noted that a data sequence from SVS can be easily confused with a time 
series of a chaotic attractor with noise. Fig. 5 shows the plotting for successive Xn+i to Xn for 
the same data sequence used above for calculating D2 and A. This plotting looks very similar 
to what one would get for a time series of a chaotic attractor with noise. How to distinguish 
a data sequence between that from a SVS and from a chaotic attractor with or without 
noise is still undertaken. To conclude, we will say that the data sequences from some SVSs 
are predictable with a nonlinear SIS prediction algorithm although the SVSs do not exhibit 
chaotic attractors. This result encourages us to apply the prediction algorithm to predict 
the data sequences from natural systems no matter their environment parameters change 
slowly or rapidly. However, there are still some theoretical problems needed to be clarified 
if one wants to apply the usual ways of characterizing the chaotic attractors to characterize 
the data sequences from SVSs otherwise misleading results might be obtained. At last we 
noted that all the discussions in this Letter can be extended to discuss the dynamical systems 
described by differential or difference-differential equations. 

H.P.F thanks Prof. Hao Bailin for his encouragement. 



Figure Captions 

Fig. 1 The developing diagram of the logistic map in the parameter interval e [1.6, 1.8] 
with Sfx = 10"^ 

Fig. 2 One-step ahead prediction results for the developing structure of the logistic map 
shown in Fig. 1 with fi G [1.74,1.76]. The crosses are the true data points and the 
diamonds are the corresponding predictive ones. Only one point in each 20 data points 
is plotted. 

Fig. 3 Prediction error for Fig. 2. xt and xp are the true and the corresponding predictive 
values respectively. 

Fig. 4 Prediction error from the developing structure of the Henon map with its parameters 
changes nonlinear ly shown in Eq. 5. 

Fig. 5 The plotting for successive to x„ for the first 10,000 data from Eq. 4. 
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